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Abstract 

Perhaps more than ever before, college teaching is being studied and 
evaluated. This paper describes the development of a simple descrip- 
tive instrument used to focus observers* classifications and ratings 
of college teachers' instructional behaviors as recorded on video tape. 
The need for such an instrument is reviewed, the methodology for test- 
ing the reliabilities of its measures is described and possible appli- 
cations are outlined. The statistical findings (Spearman-Brown esti- 
mates of reliability ranged from .68 to .95 and averaged .81; four dis- 
crete factors emerged through factor analysis of the intercorrelations 
among grouped observers' mean ratings of instruction) and projected modi- 
fications are also presentedv Further research is indicated and the 
plans for such research are summarized. 
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An Instrument to Describe College Teaching: A Reliability Study 

Much attention is being accorded the evaluation of teaching at the higher 
education level. We frequently hear about student ratings and observations of 
instructors and other methods of identifying effective teaching. An important 
question not often asked and one which must be asked prior to perfecting methodology 
is: " What is effective teaching? " Is it that teaching which results iri increased 
learning? Or in increased satisfaction with the learning process? Or in both? 
Does increased satisfaction facilitate learning? Certainly these sorts of re- 
lationships are implied when institutions that exist for the purpose of pro- 
moting learning reward teachers for "effective" teaching. 

The literature on effective college teaching is not definitive. Dunkin 
and Biddle (1974) have suggested several reasons for the failure of educational 
researchers to define effective teaching despite over sixty years of study. They 
suggest the single most significant shortcoming^Js the failure to observe teaching 
activities. The present study is primarily concerned with developing a reliable 
observational measure of the lecture method of instruction. As a future step we 
intend to study other basic practices of college teaching and their possible relation- 
ship to learning. Ultimately, our aim is not to evaluate teachers, but to collect 
information to be used as feedback to the instructors observed with the goal of 
improving college teaching. 

Background 

Gage and Berliner (1976) describe the connections between models of teaching 
and theories of learning as tenuous. Investigations of learning styles, however, 
seem more likely to result in such connections (Gagne, 1976, Chap. 2). It has 
been suggested (Joyce and Weil, 1972, Chap. 17) that a framework, for matching 

. 4 
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learning styles and instructional strategies be created. Investigations pur- 
porting to measure teaching effectiveness are frequently criticized for their 
narrow scope. McKeachie and Kulik (1975, Chap. 6) cite the lack of concern 
for the instructor out-of-class time in models for evaluating teaching effec- 
tiveness. In the same vein, those who study teaching and the evaluation of 
its effectiveness are cogently remonstrated by Wilson, Gaff, Wood, Dienst and 
Bavry (1975) for their lack of consideration of the diversity of teaching con- 
text, the disparity between student and teacher goals and the range of insti- 
tutional philosophical orientation- Hildebrand, Wilson and Dienst (1971) iden- 
tified several types of teaching and, as reported by Wilson et aK, concluded 
that no single model of effective rteaching exists; "teachers who exhibit dif- 
ferent teaching styles appeal to students who have different college goals" 
(p. 18), Meredith Gall (Note 1) has further cautioned researchers to consider 
specific teaching styles, as well as curriculum objectives and instructional 
settings in their assessments of teaching effectiveness. He suggests closing 
such inquiry with the administration of tests created to be responsive to the 
"idiosyncratic outcomes of the teaching skills and curriculum objectives. " 
Similar concern for the measurement of student outcomes as criteria for teaching 
effectiveness has been registered by McKeachie, Lin and Mann (1971) and by 
Burnett (1974). 

There are some who express doubt that teaching technique has any relation- 
ship to learning (see Gagne and Rohwer, 1969) and others who claim teachers do 
influence learning but that there^^>is no significant difference in the amount 
of learning based on teaching method (Dubin and Taveggia, 1968). On the other 
hand, McKeachie (1969) argues that teaching method or behavior does have some- 
thing to do with student satisfaction and, though the correlation between sa- 
tisfaction and learning is low, "we'd all prefer to have students leave class 
with warm feelings about their experience" (p. 210). 

.5 
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Joyce and Weil (1972) summarUe seventeen models of teaching, claimed 
by their authors to be par'ticulaf'':/ effective for certain kinds of learning. 
Whether or not such relationship^ ej(ist, Joyce and Weil conservatively, but 
convincingly, state "It sg^"is reasonable to suppose that, as our technology 
for studying teaching and l^arnifiQ improves, people will discover regulari-^ 
ties in the teaching-lear^ri''"9 Proc^s^ that have not been apparent before. A 
few general methods may err^^^ge as superior" (p. 4). The general methods or 
strategies resulting from ^^ch in^Mi^y will employ certain behaviors which we 
will then correctly label ''effective''- In order, then, to define effective 
teaching our research must look at teaching and its relationship to learning. . 
The development of a relial^^e ob5^^vational measure of teaching behaviors is an 
inportant first step in the Process, Because lecturing is one form of college 
teaching that is widespr^a^^ across disciplines, our first efforts were directed 
at studying this mode of instruction' Future energies will be directed at 
other modes of instruction* " 
Method 

Our initial step, was '^^ add^^^s the first question raised by this paper, 
"What is effective teachin9?" Fi^5t> We conducted a review of the literature 
on teaching which yielded ^ pool variables assumed to contribute to better 
learning (see Rosenshine a^^ Furst, 1971, Chap. 3; Nuthall, G. and Snook, I., 
1973, Chap. 2). Next, We review^^ the literature on human learning which 
yielded a set of character'^^tics^^sunied to affect consistently the acquisi- 
tion and retention of info^n^atioH* Finally, a review of the literature on : 
course and instructor eval^^tion i^ielded some factors which seem to contribute 
to increased student sati^'^^ctioH With the teaching-^! earning process. This 
tri-lateral review process ^howe^^ a high degree of semantic and conceptual 
overlap. We listed the descriptors of teaching behaviors, then abstracted 
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commonalities, and ultimately created a set of potentially effective lecturing 
behaviors. The set is displayed in Table 1. 

Based on the assumption that the items listed in Table 1 were reasonable 
descriptions of effective college teaching behavior during lectures, we pro- 
ceeded to design an observational rating schedule and a study of the relia- 
bility of the measures which would result from the employment of the instrument. 
Having constructed the instrument as a group, the experimenters found it possible 
to arbitrate differences in their interpretations of-teaching pei^fbrman^ We 
expected that similar arbitrations during an observer training period would result 
in a high degree of agreement in observer judgement. We thus expected our inves- 
tigation would result in a reliable measure of lecturing behavior . During the 
practice observation sessions we described our rationale for the rating of each 
behavior in order to calibrate our judgement during the independent observation 
period. Noting some redundance in our expressed r3actions, we decided we had not 
eliminated conceptual overlap in the wording of the descriptors. Accordingly, jve ' 
expected several discrete factors to emerge during the analysis of the data . 

Subjects 

The 20 subjects were full-time faculty and teaching assistants from nine 
departments at the University of California at Davis. Most requested videotaping 
as part of thi U.C. Davis Teaching Resources Center^ s instructional improvement 
program. When informed of the proposed concurrent investigation, they agreed to 
contribute three videotapes and to complete the required paperwork in return for 
detailed feedback from theCenter's videotape analyst. 

Observers and Observer Training 

During a one-month period prior to the data-gathering'stage, two of the, authors 

met. with two graduate students for a total of sixteen hours of training. The 

i ' 

■7 



Describing College Teaching 

""" . ' 6 

training period commenced with detailed discussions of the nature and scope of the 
categories for the observation, and culminated with three practice observation-^ 
rating sessions of three training tapes. When the. observers each expressed 
confidence in their ability to observe and rate the teaching behaviors described 
by the i;vstrument, the taping and rating segment of the study began. 

Apparatus 

A Sony Portapak'.3400 series videdcamera and recorder were used to record 
the classroom instruction- A built-in timer which registers minutes and tenths 
of minutes permitted the observers to start and stop the tapes at very nearly 
the same points in recorded time. A Sony CVM-115 video monitor was used for 
playback purposes. The tapes were recorded in various classrooms and lecture 
halls on the Davis campus. Ratings were recorded on an observational schedule. 
Student and instructor evaluations of teaching were collected. Written classi- 
fications of instructor intent and reactions were also collected as were forms 
requesting demographic information. 

Procedure 

The twenty instructors permitted the first thirty minutes of three fifty- 
minute lectures to be videotaped. The four trained observers reviewed the sixty 
tapes in an essentially random order; the order of acquisition. The observers 
stopped the taped playback every five minutes and rated the instruction, using the 
twenty-one categories of the instrument to structure their observations. For each 
of the first five five-minute periods, the observers recorded ratings- for items one 
through fifteen. Only after the sixth period were ratings recorded for all 21 
variables. Ratings consisted of a four point Likert scale with the descriptors 
of "strong" or "slight disagreement" and "slight" or "strong agreement," encoded 
one through four, respectively. Variables which corresponded to behaviors not 
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present'were encoded "non-applicable/' with a value of zero, and deleted from 
calculations. When the sixty tapes had been observed and rated by the four 
observers, the data from those 240 rating schedules, incorporating 96 ratings 
each, were keypunched onto IBM cards and statistically analyzed. 

Results and Discussion 

The mean ratings for the combined observers and for each variable across 
"'alT'instru^ and tapings were calculated and are presented in Table 2. The 
Pearson product-moment correlation program from the Statistical Package for the 
Social Sciences (SPSS) (Nie, Hull, Jenkins, Steinbrenner and Bent, 1975) was utilized 
and the resulting coefficients are also presented in Table 2. The coefficients 
are based on data from the sixth five-minute period across 58 of the 60 video tapes. 
Two video tapes of less than 30 minutes in length were deleted from the sample. 
In the third column of Table 2, estimated reliabilities, for each variable are 

presented. The Spearman-Brown Prophecy formula: 

^ n r Where n = number of raters and 

... - ]+(,n_i)p p =: average correlation (based 

on z conversion) 

was used to estimate the inter-rater reliability of composite ratings of the 
four observers. These reliability estimates range from .68 (for Item 13) to ^ 
.95 (for Item 1) and are comparable to those obtained from most standardized 
tests. The maan of the estimated reliabilities among all the variables is .81. 
This value was obtained by averaging the z coefficients, converting to f, and 
using the Spearman-Brown formula (see Equation 1). 

Rowley, in an article on the reliability of observational measures, corrected 
the common misconception that reliability coefficients refer to the reliability of 
the instrument itself (1976). Rowley points out that such coefficients should 

only be considered in determining the relative reliability of each of the measures^; . 

which an instrument is designed to calculate. The data presented in Table 2 
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clearly show the disparity in reliability among teacher behaviors the instrument 
was designed to describe. The infrequency of certain behaviors undoubtedly contribute 
to the lower reliability of some measures. Other low reliabilities may have been 
influenced by insufficient observer training, inconsistency of instructor behavior 
or difficul t-to-rate interactions. 

In any case, the lowest reliability coefficients obtained .in this study are 
still sufficiently high to support the primary hypothesis, that the observational 
schedule is capable of generating several reliable observational measures of college 
teaching. 

Strong intercorrelations among the means of the combined observer ratings of 
the 21 variables suggested an underlying factor structure that was explored and 
defined through factor analysis. Varimax Factor Analysis using SPSS's (Nie, et al, 
1975) alpha procedure was utilized. To obtain the factor score coefficients in 
Table 3, the ratings of the four observers for each of the three tapings and for 
each of the six five-minute periods for each instructor and each variable were 
pooled. The 72 resulting ratings (4x3x6) were averaged and the intercorrelations 
among the means were factor analyzed. As^how]rH^nJ;ab^ discrete factors 

emerged. Factor 1, which accounts for 74.4 percent of the rotated variance, seems 
to be a general measure of instructional competence; of Task-Orientation . Both 
cognitive and affective variables, . as well as direct and indirect behaviors compose 
this cluster. Factor 2, explaining 11.5 percent of the rotated variance, is 
composed of those variables relating to Use of Resources . Allowing opportunity 
for student involvement, soliciting and receiving such involvement in a non- 
threatening fashion, using the student ideas that result, giving feedback, demon- 
strating prowess with questioning strategies and purposes, and giving the impression 
that^one enjoys both content and process, contribute to a cluster that Kas face 
validity- The third factor, which explains 8.1 percent of the rotated variance, 

10 



Describing College Teaching 

9 

is a measure of Verbal Presence > All the variables composing this cluster refer 
to verbalization or verbal pacing- The inclusion of variable 17, the utilizing 
of diverse resources, seems logical. An instructor who competently engages 
students in dialogue that contributes to the development of a topic would certainly 
be .judged as one who uses diverse resources (the students and their contributions) 
to illustrate principles. Factor 4, accounting for 5.9 percent of the rotated vari- 
ance. Is composed of two variables, one measuring physical demeanor and the other, 
the use of the blackboard. This factor is a measur e of Physical Presence^ ^JThe.. — 
actual correlation between variables 19 and 21, the two components of the Physical 
Presence cluster, is just .53, as presented in Table 4. It seems reasonable that 
some relationship would exist since those lecturers who are too podium-bound to move 
to the board certainly do not exemplify attractive physical demeanor. It also seems 
reasonable that the relationship would not be a particularly strong one since the 
opposite phenomena also occurs occasionally, i.e., the lecturer who is so absorbed 
by boardwork as to preclude non-verbal interaction with ^iudents. The absence of 
such interaction would lead observers to lower ratings on the physical demeanor 
variable. The inter-correlations presented in Table 4, on further examination, 
provide specific evidence of the relationships among the variables which compose 
the clusters described in Table 3. 

Table 5 presents the correlations between average observer ratings in each 
category and average student ratings in each category for the 20 instructors. All 
but three are significant at the .05 level of confidence. Students were asked to 
rate the instructor's behavior at the time of the taping. Nevertheless, their 
ratings may be summative across all of their experience with their instructor. 
If this summation is taking place it would reduce the magnitude of the correlations. 
Such disparity is not, however, evidence that either students or observers ratings 
are more Valid than the other. Cosin, Greenough and Menges (1971) did find, in 
their review of validity studies related to student ratings of teaching, that 
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summative ratings consistently and strongly correlate with early-in-the-course 
ratings. A more reasonable explanation for a reduction in magnitude of the 
correlations between student and observer ratings is one which emphasizes the basic 
differences in. rating the teaching process alone versus rating the process as it 
explicates the content. 

The three non-significant correlations were "integrates, relates and categorizes'' 
(0S2), "attractive physical demeanor" (SP2), and "charts, diagrams and boardwork" 
(VI2). The first disagreement may have resulted from the students' focus on 
note-taking in contrast to the observers' attention to the verbal behavior of the 
instructor. The second disagreement (on the physical demeanor of the instructor) 
seems to have resulted from the refusal of many students to rate this trait. A. 
number of students wrote on the rating sheet that they felt this category was 
unfair, arbitrary and inappropriate. The final disagreement (on the use of 
charts and diagrams) was probably a result of the fact that this behavior was 
relatively infrequent in most and totally absent in three instructors. 

The other correlations range from the low .40 's to one correlation of .88. 
Nearly all of the components of factor 1 (c.f- Table 3) were items with high 
agreement between students and observers. The highest correlation ("speaks audibly 
and clearly") indicates the importance of this behavior in raters minds; but it 
should be noted that this category had the smallest variance of all the ratings, 

» 

with most raters assigning it a "strongly agree." 

< 

Plans for Future Research 

The four factors identified through the factor analysis of grouped means 
(Table 3) wilT'now compose the redefined observational instrument. Future 
investigations will center on an initial reliability study of the redefined in- 
strument and cross-referenced validity studies where the ratings of students and 
the self-ratings of the instructors are factor-analyzed and correlated with the 
factor analyses of trained observersV ratings. Whitely and DoyleJ1976) have 
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suggested that imp! icit relationships among facets of teaching behavior exist 
in the minds of those who rate such behavior. The authors of this study expect 
to address, in future examinations of the instrument, the hypothesis that implicit 
factors do exist. 

Increasing attention is being paid tr of general izability of 

the measures which an instrument provide els mJ Dempsey, 1976; i — Since — 

our data were collected in an ANOVA dtsign, they will be re-analyzed from a . 
general izability standpoint at a later date. • . 

Most importantly, the authors plan to design studies w'-'^h will investigate 
the relationships between particular instructional stylet* . positive student 
outcomes. It is hoped that such investigations will contribute to the identification 
of effective college teaching behaviors and provide impetus for instructional change 
programs . 
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Reference Note 



1* Gall, D. The Importance of Context Variables in Research on 
Teaching Skills- In B- Ward (Chair), " What does recent research 
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Francisco, 1976- 
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A list of teaching behaviors employed in the college classroom and intended 
to structure the systematic observation and rating of college teaching. 



Item 
1 
2 
3 
4 
5 



10 
11 

12 

13 

14 

15 

16 

17 

18 
19 
20 
21 



Variable 

Clarity^ 

Clarityg 

Enthusiasm^ 

Enthusiasm^ 



^1 



Organization- 
Structuring, 
Organization- 

Struc' ingg 
Knowledge o. 

Subject Matter^ 
Knowledge of 

Subject Matterg 
Interaction^ 

Interactiong 
Support^ 

Support2 
Questioning 

Tactics^ 
Questioning 

TacticSg 
Questioning 

Tactics^ 
Variability^ 

Varlabllltyg 

Stage Presence^ 
Stage Presence2 



Use of Visuals 



Use of VisualS2 



Description 

The instructor speaks audibly and clearly. 
Instructor Is able to simplify concepts. 
Instructor Is energetic, stimulating, involved. 
Instructor appears to enjoy both content and process. 
Instructor presents materials in an orderly, logical - 

manner, making clear and logical transitions. 
Instructor Integrates, relates and categorizes to 

aid both comprehension and note-taking. 
Instructor projects command of material. 

Instructor answers^ student questions and concerns or 
redirects them to appropriate resources. 

Instructor provides opportunity for expression of 
other opinions, assenting and dissenting.- — - 

Instructor uses student ideas and comments. 

Instructor solicits and receives Involvement in an 
accepting, non-threatening manner. 

Instructor gives feedback appropriately. 

Instructor displays facility with strategic ques- 
tioning tactics.' 

Instructor utilizes questions for many purposes. 

Instructor addresses questions' to many individuals 
and groups. 

Instructor displays a repertoire of skills, adapting 

his pace and techniques to the material being presented. 

Instructor utilizes diverse resources to Illustrate 
principles 

Instructor's verbal behavior Is confident and effective. 
Instructor's physical demeanor is attractive and assured. 
Media easy to follow and pertinent to lecture. 
Charts, diagrams, boanlwork are appropriate and 
presentation Is effective. 



♦Formal Lecture Observation Assessment Technique 
© 1976 
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Table 2 . 

Average z Coefficients, Converted Pearson r Coefficients and Estimated 

Reliability Among Four Observers* Ratings of College Teaching Behaviors 

Average z Coef- Converted Estimated Reliability 
ficient among Pearson r (corrected by Spearman- 
Item Variables all observers Coefficient Brown Prophecy Formula) 



1 


Clarity^ 


.82 


.68 


.95 


2 


Clarltyg 


.58 


.52 


.85 


3 




.53 


.48 


.82 


4 


i- i i .i snig 


.53 


.49 


.82 


5 


Organization- 










Structuring^ 


.43 


.41 


.76 


6 


Organization- 










Structurin'&2 


.45 


.42 


.77 


7 


Knowledge of 










Subject^ 


.58 


.53 


.85 


8 


Knowledge of 










■Subject2 


.38 


.37 


.71 


9 


iTCeraction^ 


.52 


.48 


.81 


10 


IntaEractiong 


.41 


.39 


.74 


11 


''SaBporti 


.56 


.51 


.84 


12 


Stq!rport2 


.35 


.34 


.68 


13 


Questioning^ 


.35 


.33 


.68 


14 


Question1ng2 


.39 


.38 


.72! 


15 


Questioning^ 


.36 


.34 


.69 


16 


Variability^ 


.77 


.65 


.93 


17 


VdHabilityg 


.52. 


.48 


.81 


18 


Stage Presence^ 


.56 


.57 


.84 


19 


SiJ^je Presenceg 


.67 


.58 


.89 


20 


l^^pfof Visuals^ 


No data 


No data 


No data 


21 


dteof Visual Sg 


.44 


.42 


.76 
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Varimax Rotated Factor Matrix by Grouped Observers 

Factor 2 

Use of Resources 
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Coefficient item 



Description 



Coefficient 



2 


II 

t 


simplification of concepts.,," 


• 87 


4 


H 


••enjoys content and process^.. 


" .46 


3 


11^ 


••energetic, stimulating, involved..," 


• 85 


9 


11 


.•opportunity for opinion..." 


.48 


4 


II 


.•enjoys content and process..." 


.84 


10 


II 


. .uses ideas. . . " 


47 


5 


M 


..orderly, logical presentation,, ." 


.93 


11 


II 


. .solicits involvement. • 


.71 


6 


II 

• 


..integrates, relates, categorizes,*." 


.92 


12 


II 


..gives feedback. . ." 


.64 


7 


II 


. . projects command ..." 


.94 . 


13 




. .strategic question. . • " 


.91 


8 


It 


..answers or redirects questions.,," 


• 69 


14 


II 


..many purposes for questions.. 


.".71 


10 


II 


,.uses student ideas..," 


• 65 


15 


II 


..questions many individuals. . . 


" .90 


11 


11 


..solicits involvement,,." 


.51 










12 


II 


. .gives feedback. , 


^56 










16 


II 


..repertoire of sktTlisr.*^- * 


•73 










17 


tl 


• .uses diverse resot0^^^^^ 


• 74 










18 


II 


..confident. effect^^m'Mees^ss^l behavior.. 


." .64 











Eigenvalue 

Percent of Rotated Variance 

Factor 3 
Verbal Presence 



Item 
1 

8 

9 
16 
17 
18 



Description 
..speaks audibly. . 

..answers or redirecg^ ^^atlons. .." 

..opportunity for op? ir^w^*. . 

..repertoire of skilH. 

..utilizes diverse resources-.." 

..confident, effectrkv** vmhal behavior 



12.398 
74.4 



Coefficient 
.77 



Eigenvalue 

Per cent of Rotated Variance 



1.922 
11.5 



Eigenvalue 

Per cent of Rotated Variance 



.38 

.40 

.43 

.51 

" .58 

1.356 
8.1 



Factor 4 

Physical Presence 

Item Description Coefficient 

19 "...attractive physical demeanor. .".80 

21 "...use of blackboard.,," .87 



Eigenvalue 

Per cent of Rotated Variance 



0.978 
5.9 
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Th< liUitrcornrlHtlons ainom^ 21 TcJChlnij Oehanlon 4S RjtcU by Four 0^servl^l*« 



Ittffli 1 - ClarUy^ 


It#«i 2 - CUrlty, 


Item 3 « tnthusiasm^ 


Iten 12 .SI Itcn 13 .S3 


It«ffl 3 .S9 Item 7 .74 


Item 2 .S) 


Item n .SI 




4 .S4 8 .70 


4 .82 


12 .55 




5 .81 16 .54 


5 .58. 


14 .52 




6 .77 19 .50 


.53 


16 .69 






7 .56 


17 .57 






8 .70 


18 .57 






10 .50 


19 .51 



Ucfli 4 « Enthmlaswu 
Itn 2 .54 Item 11 .62 



3 .82 

5 .67 

6 .60 

7 .61 

a .65 

10 .59 



12 .61 
15 .56 
'16 .66 

17 .60 

18 .60 

19 .60 



I ton 7 • ICnoi«l«d9« of 

Subject Hatter 
I tan 2 .74' Item 5 .80 

3 . 55 6 .76 

4 . .61 a .69 
Itea 12 .56 

Itcn 10 « Interaction^ 
Iten 3 .50 I ten 5 .53 
4 .59 9 .58 

Itea 11 .67 

Itn 13 - Questioning 



Tectlcs 



Itm a .52 Iten 9 .54 
Itea 16 .601 



Itefl 5 • Orginlzatlon- 

Stmcturlng ^ 
Ite« 2 .81 Iten 8 .75 

3 .58 10 .53 

4 .67 16 .57 
6.93 17.50 
7 .30 19 .50 

Iten 8 - Knowledge of 

Subject Hatter2 

Itttii 2 .70 Item 7 .69 

3 .70 13 .52 

4 .65 .V 16 .70 

5 .75 18 .57 

6 .81 19 .73 
Iten 11 - Support^ 
Ittn 3 .51 Item 10 .67 

4 .62 12 .65 

Item 15 .70 

Iten 14 - Questioning 
Tactics^ 



Iten 6 » Organizitlon- 

_ Structuring^ 

Iten 2 .77 Iten 5 .76 

3 .53 a .81 

4.60 16.59 

.5 .93 19 .56 



Item 9 ^ Interaction^ 
Item 10 .53 Iten 13 .54 



Iten 3 5.2 



Itwt_12 _'» Support^ 
Item 1 .51 Item 7 .56 

3 .55 11 .65 

4 .61 ' 15 .51 

Item 17 .52 

Item 15 - QuMtlonlng 
Tactics J 

Item 4 .56 Iten 11 .71 

Iten 12 .51 



Item 16 - VaHablHty^ 
Item 2 .54 Item 8 .70 

3 .69 13 .60 

4 .66 17 .64 

5 .57 18 .62 
5 .59 19 .61 



Iten 17 « Variability, 
Item 3 .57 Item 5 .50 
4 .60 12 .52 
Item 16 .64 



Item 18 r Stace Pregence. 
Item 1 .58 Item 8 .57 

3 .37 16 .82 

4 .60 19 .53 



Item 19 ■ Stage Presence^ Item 20 - Use of Visuall y Item 21 ■ Use of Visually 
Item 3 .51 Item 6 .56 - Ho OaU - Item 19 .53 

4 .60 8 .73 

5 .51 16 .61 
Item 21 .531 



Hotel Only correlations >»5Q are cited in this table. The Inverses of cor« 
reUtlons are accumulated as the Itstlno progressos. 
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Table 5 

Correlations between Grouped Stf.dents and Grouped Trained Observers' 
Mean Ratings of Lecturing Behavior across Three Samples of Twenty 
Instructors' Lectures for each of Twenty-one Variables. 



it em 


Variables Correlations 




Variables Correlations 


1 


Clarity^ 


.88** 


11 


Support^ 


.57** 


2 


Clarity^ 


.59** 


12 


Support,' 


.51** 


3 


Enthusiasm. 


.67** 


13 


Questioning. 

1 * 


.48* 


4 


Enthusiasm^ 
c 


.59** 


14 


Questioning^ 


.41* 


5 


^■uryan 1 40 w> 1 uii 




15 




52** 




Structuring^ 


.43* 


1C> 


Variability^ 


.43* 


6 


Organization 




17 


Variabilltyg 


.52.** 




StructurinQg 


.33 


18 


Stage Presence^ 


.49** 


7 


Knowledge of 




19 


Stage PresencBg 


.02 




Subject^ 


.44* 


20 


Use of Visuals^ 


.49** 


,J 


Knowledge of 




21 


Use of VisualSg 


.37 




Subjectg 


.49** 








9 


Interaction^ 


.43* 








10 


Interactiong 


.47* 
















^ .01 










*P 


« .05 





19 



Burnett, C. W, Relating to l^^v^nei^s, IjnDrovinq College and University 
Teaching , 1974, 22(l)^ 49-52, 

Costin, F., Greenough, W,T. and Menges, R.J. Student ratings of college 
teaching: Reliability, validity and usefulness. Review of Educational 
Research , 1971, 4X(5)» Sll-SaB- 

Dubin, R. and Taveggia? ^- l}]S,..teaching^^ ' comparative 

analysis of coll eqg ^ jtlacjijjg^^ Eugene- Center for the Advanced 

Study of Educational Adinini^ti^ation* University of Oregon, 1968. 

Dunkin, M. J. and Biddl^^ B, J^. jtudy o'^' tea _chinq- New York: Holt, 
Rinehart ami Wins tori » Inc,^ 1^974. 

Gage, N. L. and Berlin^^* D. Ijlucat lonal psychgl ogy.- Chicago: Rand 
McNally College Publ ""^hin^ Contp^ny, 1976. 

Gagne, R. M. The learr^^^^g ba^s of teaching methods. In N. L. Gage (Ed.), 
The psychology of j ^g^hihd::^6rtj3Qds^. Chicago: University of Chicago 
Press, 1¥76. 

Gagne, R. M. and Rohwei^» W. D- Instructional psychology. In *P- H. Mussen 
and W. E. Rosenzwei^ ( Eds . ) Ag3 iial_ Reyj ew of Psychol oqy . Palo Alto: 
Annual Reviews Inc.? 1969, 

Hildebrand, M., Wilson* C. ^nci Dienst, E. R. Evaluating university 
teaching . Berkeley' Cent^^ Research and Development in Higher 
Education, University of C^lH*^nia» 1971. 

Joyce, B. andiWeil, M. {3odeTj...,of2^^ Englewood Cliffs: Prentice-Hall, 

Inc., 197Z 

McKeaclTlie, W. J. Tea^fllpg ti£§, i Ji guidebook fo r_th e beginning college 
teacher. Lexington^ D. C- Heath and Co., 1969. 

McKeachie, W, J, and.KuHk, J' A* Effective college teaching, In F, N, 
Kerlinger (ed..), JRgj^^ (Vol. 3). Itasca, 111: 

R. E. Peacock Rubli^h^rs, 1975- 



Describing College Teaching 

18 



20 



Describing College Teaching 

McKeachie, W. J,, Lin, Y. G. and Mann, W. Ratings of teacher effectiveness: 
Validity studies. American Educational Research Journal , 1971 ♦ 8(3), 435-45. 

Nie, N. H., Hull, C. H., Jenkins, J. G., Steinbrenner, K., and Bent, D. H. 
Statistical package for the social sciences > New York: ficGraw-Hill Book 
Company, 1975 

Nuthall, G. and Snook, I. Contemporary models of teaching.' In R. M. W. Travers 
(Ed.), Second handbook of research on teach Ingu - Chicago; Rand McNally 
. Publishing Co., Inc., 1973. 

Rosenshine, B. and Furst, N. Res^rch on teacher performance criteria. 
In B. 0. Smith (Ed. ) Research -tn teacher education: A symposium . 
Englewood Cliffs, N.J.: . Prentice-Hall , 1971 . 

Rowley, G. L. The reliability of observational measures. American Educational 
Research aournal , 1976, 13(1), 51-59. 

Shavelson, R. and Dempsey, N. General izabil ity of measures of teaching 
behavior. R eview of Educational Research , r^97fr, 46(4), 553-611. 

Whitely, S.E. and Doyle, K. 0. Implicit theories in student ratings. 
American Educational Research Journal , 1976, H(4), 241-253. 

Wilson,, R. C, Gaff, J. G., Dienst, E. R., Wood, L. and Bavry, J. L. 
Colllege professors and their impact on students . New York: Wiley- 
Interscience Publ 1 cation, 1975. 



21 



